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§  1  •  Introduction. 

It  is  no\^ possible ,  with  the  aid  of  the  von  Neumann  theory 

V  ^ 

of  games,  to  I'ive  a  systema^c  theoretical  treatment  of  two- 


/A.  f 

person  zero-slun^game.  ^The  techniques  of  this  modern  theory  have 
been  shown  to  have  wide\nd  important  applications  in  such  fields 
as  economic  theory,  the  theory  of  statistics,  and  so  on.  Unfortunately 
although  the  foundations  of  the  theory  are  now  classic,  the  actual 
solution  of  any  particular  game  is  generally  a  matter  of  some 
difficulty,  involving  a  combination  of  frontal  attack,  applying 
routine  methods,  and  a  type  of  mathematical  ingenuity  that  has 
been  described  as  "low  cunning." 

Consequently,  it  is  of  interest  to  present  a  class  of  games 
which  may  be  handled  by  uniform  techniques,  in  the  hope  that  an 
accumulation  of  such  examples  will  eventually  render  visible  the 
mechanism  behind  the  particular  solutions,  hitherto  discovered 
only  by  artifice.  Such  has  been  the  history  of  the  theory  of 
differential  equations,  the  theory  of  probability,  and  many  of 
the  other  components  of  the  mathematical  edifice. 

Consider  the  following  two— person  game  where  we  call  one 
player  B,  for  bettor,  and  the  other  D,  for  dealer.  Before  play 
begins  both  players  ante  one.  0  then  deals  a  card  Xj  to  B,  where 
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Xj  is  a  random  number  in  the  interval  [1),  having  the  distribution 
function  F) ,  and  a  card  yj  to  himself,  also  belonging  to  the 
interval  [P,  with  distribution  function  Of.  B  initiates  the 
betting,  with  the  alternate  possibilities  of  folding,  in  which  case 
D  wine  the  ante,  or  of  betting  an  amount  f(x),  1  <  f(x)  <  M.  Once 
B  has  bet,  D  has  a  choice  of  folding,  in  which  case  B  wins  the  ante, 
of  covering  B*s  bet,  or  of  raising  an  amount  g(f(x),  y),  1  <  g  <  M. 

If  0  raises,  B  has  a  choice  of  covering  or  raising,  and  so  on  for 
at  most  Ni  raises  by  either  player. 

After  the  initial  betting,  D  deals  two  more  cards,  X2  to  B 
and  y2  to  himself,  and  again  B  initiates  the  betting.  This  continues 
for  at  most  N2  draws.  At  the  end  of  the  betting,  the  hands  are 
compared,  and  the  stronger  hand  wins  the  total  amount  wagered.  The 
strengths  of  the  hands  are  certain  functions,  S(Xf ,  X2,  ***,  x^), 

T(yi  I  Yip  •••f  /jj)  0^“  cards,  x^,  y^.  For  the  case  of  a  deal 
and  one  draw,  the  above  describes  a  Poker  game  with  two  players; 
the  case  of  several  draws  is  analogous  to  Stud  Poker;  the  case  of 
several  draws,  but  not  simultaneously  by  both  players,  with  one  stage 
of  betting  and  .10  raises,  corresponds  to  Blackjack,  sometimes  called 
Twenty-One,  with  its  arithmetically  simpler  cousin.  Seven— and-a-Half ; 
the  case  of  no  draws  with  the  df^aler  always  covering  the  bet  is 
illustrated  by  Red  Dog,  and  clearly  many  other  common  card  games 
are  described  in  many  essentials  by  the  above  game. 

Consequently  it  is  of  some  interest  to  investigate  the  problem 
of  determining  the  best  method  of  play  for  both  players,  where  by 
"best"  we  mean  the  method  that  yields  a  maximum  expectation. 
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The  general  problen  seems  quite  difficult.  In  this  paper  we 
treat  the  simplified  game  where  no  draws  are  made  after  the  initial 
deal,  where  tliere  are  only  a  finite  number  of  bets  allowed, 

1  <  z,  <  Z2  <  •••  <  *n’  '^bh  no  raises,  and  where  the  distribution 
functions,  F  and  G,  are  both  equal  to  x. 

However,  it  seems  probable  that  the  methods  we  present  to 
treat  the  simplified  version  will  be  applicable  to  the  N-draw  game, 
ana  we  hope  to  investigat  ;  the  general  question  in  the  future. 

That  our  procedures  are  applicable  to  the  continuous  case, 

^rid  not  to  the  aiscrete  case,  depends  upon  the  result  which  is 
stated  precisely  below,  that  in  certain  continuous  games,  only 
pure  strategies  are  necessary,  whereas  the  discrete  game,  in  general, 
requires  mixed  strategies.  Here  the  terms  "pure"  and  "mixed"  are 
used  in  the  sense  of  game  theory,  and  have  no  connection  with  the 
possible  motives  of  either  player.  Given  a  card  x,  there  are  always 
several  alternate  procedures,  or  strategies  for  either  player  to 
folxow,  A  pure  strategy  in  one  v.hich  compels  him  to  follow  a  unique 
course  of  action  whenever  he  receives  a  card  x;  a  mixed  strategy  is 
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one  which  furnishes  a  rule  for  mixing  the  alternate  available  courses 
of  action  in  certain  proportions  determined  by  x.  A  pure  strategy 
than  is  a  limiting  form  of  mixed  strategy. 

This  resu-t ,  thjit  only  pure  strategies  are  required  in  the 
continuous  case,  seems  quite  unexpected,  and  at  first  sight  to  run 
counter  to  the  known  (heuristic)  theory  of  bluffing.  However,  the 
paradox  is  easily  resolved.  In  a  continuous  game,  one  allows  the 
game,  which  furnishes  a  random  card,  to  do  the  bluffing.  It  turns 
out  that  if  the  cards  are  dealt  at  random,  any  f’urther  randomization 
furnished  by  mixed  strategies  on  the  part  of  the  players  is  super- 
fluous. 

This  is  not  to  say  that  there  is  no  bluffing.  Rather,  one 
bluffs  uniformly.  This  will  be  seen  by  examining  the  solution  of 
the  one— deal,  no-draw  game  presented  below. 

To  the  best  of  our  knowledge,  there  have  been  only  two  previous 
mathematical  discussions  of  the  game  of  Poker,  the  first  by  Borel, 

([l J  ,  and  the  second  by  von  Neumann,  fX}  •  Borel’ s  treatment  depends 
more  upon  probabilistic  consiaerations  and  involves  no  systematic 
use  of  game  theory.  One  of  the  games  discussed  by  von  Neumann 
involves  a  choice  of  two  bets  for  B,  hi^rh  or  low,  (but  no  ante), 
and  a  choice  for  D,  after  having  seen  B’s  bet,  of  seeing  or  not. 

The  game  described  in  ^3  below  diffe^'s  from  this  only  in  allowing 
B  the  additional  privilege  of  folding,  at  a  cost,  however.  The 
solution  obtained  by  von  Neumann  is,  as  in  our  case,  a  pure  strategy 
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for  both  players,  with  bluffing  for  B.  Our  methods,  which  lean 
heavily  upon  Theorem  1  below,  are  different  from  those  of  von 
heumann. 

q  2.  A  Fundamental  Theorem. 

The  solution  of  a  game  is  often  simplified  if  it  is  kno%m  in 
advance  that  one  of  the  players  has  a  good  pure  strategy.  Even  if 
it  is  iinovTi  in  advance  only  that  every  mixed  strategy  for  player  I 
can  be  approximated  by  pure  strategies,  the  value  of  the  game  can 
still  be  found  by  solving  the  restricted  game  in  which  both  players 
are  limited  to  pure  strategies,  but  II  discovers  I*s  strategy.  If 
in  the  restricted  game  I  has  a  good  strategy,  this  is  also  a  good 
strategy  in  the  original  game. 

There  is  a  simple  condition  vdiich  sometimes  ensures  that 
mixed  strategies  may  be  approximated  by  pure  strategies:  if  at  the 
beginning  of  the  game  tiiere  i*^  a  chance  move  whose  outcome  is  known 
to  only  one  of  the  players ,  it  may  happen  that  he  can  use  this  chance 
move  as  a  substitute  for  mixing  strategies,  so  that  a  formally  pure 
strategy,  depending  in  an  intricate  way  on  the  outcome  of  the  chance 
move,  can  be  constructed  to  approximate  any  given  mixed  strategy. 

This  principle  guarantees  the  existence  of  such  approximating  pure 
strategies  in  the  one  deal— no  draw  case  of  the  game  described  above, 
and  most  probably  in  the  general  case  too,  although  we  have  not  as 
yet  investigated  this.  That  the  actual  good  strategies  are  pure  is 
not  guaranteed  by  our  principle,  and,  so  far  as  we  see,  could  not 
r.ave  been  predicted  in  advance. 

For  our  purpose,  the  relevant  features  of  the  game  are  the 
follov.'ing,  from  I’s  point  of  view. 


At  the  beginning  of  the  game,  there  is  a  chance  move  consisting 
of  the  selection  of  a  number  x  at  random  from  the  unit  Interval. 
X  is  known  to  I  but  not  to  II. 


1 . 


2.  I*s  strategy  is  the  choice  of  a  number  i  »  1,  N,  depending 

on  X,  i.e.y  a  furiction  i(x),  assuming  only  values  1,  ***,  N. 

3.  The  outcome  w(x,  i;  t) ,  where  t,  II 's  strategy,  may  now  vary 
over  an  arbitrary  space,  is  for  fixed  i  and  z,  a  function  of 
X  consisting  of  R  (fixed)  continuous  pieces,  the  modulus  of 
continuity  of  the  pieces  being  uniform  over  (i,  z).  (In  the 
poker  game  described,  w  consists  of  two  cor;stant  pieces  over 
the  sets  x  <  y,  x  >  y.)  Moreover,  w  is  uniformly  bounded; 
say  |w|  <  N. 

The  payoff  to  player  I,  i.e.  ,  the  expected  outcome  for  fixed 
pure  strategies  of  I  and  II,  is  then 

(1)  v(i(x);  z)  ■  ’^(*1  z)dx. 

Theorem  1 .  In  a  game  satisfying  1 ,  2,  3 ,  for  every  mixed  strategy  F 
for  I  and  every  6  >  0 ,  there  is  a  pure  strategy  1 ( x )  such  that ,  for 

every  z, 

(2)  v(F;  z)  <  v  (i(x) ;  z)  ♦  €  . 


Proof.  A  mixed  strategy  F  for  player  I  is  a  choice  of  N  functions 

N 

Pi(x)»  **•»  Pi^*^  -  21  1  i’or  each  x,  p^(x) 


specifying  the  probability  he  chooses  1  with  a  given  x.  Then 
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v(F;  z)  -  ^  P  w(x,  i;  z)  p^ix)  dx.  Divide  the  interval 
i-1  VO  ^ 

0  <  X  <  1  into  disjunct  subintervale  I|,  •••,  ^  ^  ' 

where  6  is  chosen  so  that  each  continuous  piece  of  each  w(x,  i,  s) 
varies  by  less  than  €  over  any  interval  of  length  6  .  Now  divide 
Ij  into  N  intervals  ,  *•*,  so  that 

■  c/i  Pk‘*>  “*• 

J 


Then  the  pure  strategy  i(x)  ■  k  on  J 

is  the  required  approximation  to  P,  For 


1,  n,  k  -  1,  N 


D  -  v(F;  z)  - 


(i(x) ;  z)  -  ^ 


where 


w(x,  k;  z)  p.  (x)  dx  - 


w(x,  k;  z)  dx. 


Hence,  |D|  <21  ^  *  2MNR6  ,  where  C  contains  those  j*8 

jeC  k-1 

for  which  every  w(x,  k,  z)  for  the  given  z  is  a  single  piece  over 
Ij.  The  bound  2MNRS  follows  from  the  fact  that  there  are  at  most 
NR  J’s  not  in  C.  For  J  ^ C, 

(5)  IV'  ^  '“jk  Jl  Pk<*>  -  ^jk  ^  dx|  <£m(Ij^), 

•Lx  ^  X  xi. 


where  U,  L  are  the  upper  and  lover  bounds  of  w(x,  k,  z)  over  the 


V 
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Interval  Ij.  Then 


(6)  |DI  <  ^  ♦  2MNR6  <64  2MNR  6  . 


Since  S  is  arbitrarily  small,  the  proof  ie  complete. 

§  3 •  The  Solution  of  a  One— Draw  Poker  Game. 

In  this  section  we  present  the  solution  to  the  one-draw 
poker  game  with  no  raises  and  tv;o  bets  of  magnitude  ,  Z2 , 

^2  ^  >1  ^  ^0,  a  constant  specified  below,  the  size  of  the  ante  being 
one.  Complete  details  and  discussion  of  the  general  case  involving 
raises  and  a  wider  selection  of  wagers  will  be  presented  subsequently. 

The  solution  shows  that  D’s  strategy  is  unique  and  involves 
no  bluffing,  in  the  sense  that  he  never  calls  with  a  weak  hand,  vhile 
B*s  strategy  is  semi-determinate  and  involves  one  type  of  bluffing, 
betting  high  in  low  hands,  but  not  the  other  type,  betting  low  on 
high  hands. 

B*s  strategy  is  shown  diagrammatically  by  the  following 
decomposition  of  the  x  interval  (O,  . 


Low  and  High  Low 


High 


where 


(2)  ai  -  1  -  c, 

a^  -  1  -  c^Ci/2  , 

(where  we  have  set  Cj  ■  2/2^Zj  ,  c^  ■  2/2-*-Zg) , 


B  bets  high  if  <  x  <  1 ,  low  If  a]  <  x  <  a2  and  if  0  <  x  <  a| 

must  bet  high  H  on  a  set  of  measure  (1  -*02)  C)C2/2,  low  on  a  set  L  of 
measure  (1  —  Cj)  (C|  —  C)C2/2),  and  fold  on  the  remaining  part  of 
[0,  ajJ.  The  sets  H  and  L  are  of  fixed  measure,  but  their  location 
is  arbitrary  within  [0,  a J . 

D*s  strategy  is  exhibited  by 

(3) 

0  b,  b*  Hl«h  1 

where  b,  -  a, ,  b2  ■  1  -  C2.  D  folds  if  0  <  y  <  b, ,  sees  a  low  bet 
if  y  >  b, ,  and  a  high  bet  if  y  >  b^.  From  this  it  is  clear  why  the 

exact  location  of  the  sots  on  which  B  bets  high  or  low  when  he  has  a 

card  in  the  interval  [O,  aj  is  of  no  importance.  The  value  of  the 
game  is 

2 

lu)  V  •  -  (1  -  c,)  +  c,C2{c,  -  C2), 

which  is  always  negative  for  U  <  C2  <  Cj  <  Cq »  where  Cq  is  the  smallest 

root  of 

3  2 

(5)  c  -3c  ♦l6c-8"0, 

Co  ^  *76.  The  constant  Zq  mentioned  above  is  2/co^2  »  .62.  Thus  we 
see  the  character  of  the  solution  changes  at  the  point  where  the  game 
becomes  fair  to  13.  We  have  not  az  yet  investigated  the  game  in  the 
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case  Z)  <  Zqi  since  the  most  interesting  case  is  Zj  ^  ^  ^ i  (the 

amount  of  the  ante). 
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